2025-04-03 16:57:42,689 [ 634206 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-03 16:57:42,689 [ 634206 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-03 16:57:42,689 [ 634206 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-03 16:57:42,689 [ 634206 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_mp2qo7 --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_update_one_cluster -vvv" altinityinfra/integration-tests-runner:cd6390247eca '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: random-0.2, timeout-2.2.0, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 2 items test_reload_clusters_config/test.py::test_delete_cluster PASSED [ 50%] test_reload_clusters_config/test.py::test_update_one_cluster FAILED [100%] =================================== FAILURES =================================== ___________________________ test_update_one_cluster ____________________________ started_cluster = def test_update_one_cluster(started_cluster): send_repeated_query("distributed") send_repeated_query("distributed2") > assert get_errors_count("test_cluster") > 0 E AssertionError: assert 0 > 0 E + where 0 = get_errors_count('test_cluster') test_reload_clusters_config/test.py:202: AssertionError ------------------------------ Captured log call ------------------------------- 2025-04-03 17:00:28 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:00:40 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:00:52 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:01:04 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:01:17 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:01:31 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:01:43 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:01:55 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:02:07 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:02:20 [ 624 ] DEBUG : Executing query SELECT count() FROM distributed2 SETTINGS receive_timeout=1, handshake_timeout_ms=1 on node (cluster.py:3760, query_and_get_error) 2025-04-03 17:02:32 [ 624 ] DEBUG : Executing query SELECT errors_count FROM system.clusters WHERE cluster='test_cluster' and host_name='node_1' on node (cluster.py:3677, query) ---------------------------- Captured log teardown ----------------------------- 2025-04-03 17:02:32 [ 624 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/.env --project-name roottestreloadclustersconfig --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml stop --timeout 20] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/.env --project-name roottestreloadclustersconfig --file /ClickHouse/tests/integration/test_reload_clusters_config/_instances-1/node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml down --volumes] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Removing (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-node-1 Removed (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Removing (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Removing (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo3-1 Removed (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Container roottestreloadclustersconfig-zoo2-1 Removed (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Network roottestreloadclustersconfig_default Removing (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stderr: Network roottestreloadclustersconfig_default Removed (cluster.py:148, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Docker networks for project roottestreloadclustersconfig are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 17:02:40 [ 624 ] DEBUG : Docker containers for project roottestreloadclustersconfig are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 17:02:40 [ 624 ] DEBUG : Docker volumes for project roottestreloadclustersconfig are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 17:02:40 [ 624 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadclustersconfig-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : No running containers for project: roottestreloadclustersconfig (cluster.py:922, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 17:02:40 [ 624 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Stdout:1 (cluster.py:146, run_and_check) 2025-04-03 17:02:40 [ 624 ] DEBUG : Volumes pruned: 1 (cluster.py:958, cleanup) ============================== slowest durations =============================== 135.65s call test_reload_clusters_config/test.py::test_delete_cluster 124.61s call test_reload_clusters_config/test.py::test_update_one_cluster 25.25s setup test_reload_clusters_config/test.py::test_delete_cluster 8.03s teardown test_reload_clusters_config/test.py::test_update_one_cluster 0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_reload_clusters_config/test.py::test_update_one_cluster =========================== short test summary info ============================ FAILED test_reload_clusters_config/test.py::test_update_one_cluster - Asserti... PASSED test_reload_clusters_config/test.py::test_delete_cluster =================== 1 failed, 1 passed in 293.61s (0:04:53) ==================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_mp2qo7 --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_update_one_cluster -vvv" altinityinfra/integration-tests-runner:cd6390247eca ' returned non-zero exit status 1.